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Al>sf rnr.l. 

(.otinnioMrnl i^»ii pr»»ior»'t|s *Mn’ known lo inlinmrf? ilir nl.ilization ?hkJ 
porloriiiJinr!' of rnminMnif‘nl ir»n in’i nv^rk. In I.lii5 papt'r» wr invnsiigarr 
rlir t'lforl of t wo rtikrn ring prfHornis i»n ngigninl. network with iiinltiplr 
tin si rnrt n If* . In I In* litsi n nofle srn*ls «tt iiii’jsl. on#.* 

on ff'ceiving t\ tf»krn. In I In* srrnnil protorol, n noilo soinU aM the 
wniriiig niess;»j»»'s whrn n iMkffi i.s ri'f‘i*iv«Ml. 1 In* t>rliiivinr of these 
protocols is shown t#> In* hij|»hly ilfpi'inlent on the tniiiiln?r of rings ns 
well as the the loail iti the n»*twork. 


1 Introiluction 

'Thr nse nf parallel rntniiHfftiealioM rliannels to arhieve a gigahit network is 
a very in1<*resling romrpi. I ispei iaily. if a uigafiit nelwork needs In lie limit 
from an existing ronmimi earlier system, a network of parallel ehaiinrls may 
1)0 a viable alternate. Ilm\evi*i. its appropriateness eaii only he asccrlainod 
after ilotcrmi iiing its heliavior niuler difleri*nt load ronditions. lo this cimIi 
we chose a parallel ring network operating on lokon-hased protocol.^. 

Ctirreiilly, onr studies are restricted lo two token-ring protocols. With 
each of the protocols, a token is assigned to each of the rings in the network# 
All tokens rotate in the same direction. While a node i.s holding a token for 
tran.smi.s.sioii« it cannot hold any other token. 

I. Exhaustive INilicy: Under thi.s policy, when a nmle nbiaiiis a token, it? 
traiismii.s all the messages in its cpiene, ami then releases the token# 

•This work was sifp|wiftrd i» pnri hy C tH* tniilrr iNK-SthlWIJ.in, hy NA.^A Mticirr 
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2. Non -exhaustive l\)li(v: Under this policy, a node ran transmit at most 
one message when it reteives a tok('n. 

In this report, we describe the results obtained from simulations of these 
two protocols, rrom these K’sults, we make some comments regarding the 
appropriateness of parallel ring structun's opeuating at gigabit spce<ls. 

2 Parameters 

In order to determine the behavior of the multiring token-i)a.scd protocols, 
we have run a numb('r of experiments, ^'ollowing is a stimmary of tlie input 
data: 

• Since we are only interested in gigabit networks, -we have considered 
the total bandwidth of the network to be 10'* bits/scc. 

• When there are U rings in the system, each ring has a bandwidtli of 
10-7/^ bits/sec. 

• Since token-ring protocols are only relevant for local area nets, we 
considered a total ring length of 30 Km, with 30 c(|ually spaced nodes. 

• The propagation delay on the network is taken to be half tlie speed of 
light (i.e. IbOKm/msi'c). 

• For simplicity, we assume constant length messages (lOK bits). Kach 
message is transmitted as one entity (i.e, no fragmentation). 

• The load on the network is expres.sed in terms of mean-time between 
arrivals (m) of messages at any node. Low loads are represented by 
m = 1.0, which denotes that one the average a message may be ex- 
pec tc<l once every I m.sec at each node. High load is repre.sented by 
m = 0.31. We have used ;// = 0.r>,0.-1, 0,3.^> as other values. Message 
arrivals are a.ssiimed to be Pois.son. 

3 Results 

The performance of the protocols is based on simulation of the network. The 
siimilation wa.s carrietl out for 10 seconds. 1'he .system was let to stabilize 
ill the first .'V seroiols, and the statistics were then taken in the sccoiul half 
of the experiment. 
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Wo make the following nl)s('rv;it.ions from the ohtivincMl results: 

• In Kij^uro I, we roinpnre the average time that a. message at the head 
of a qnono at a node needs to wait hefore a token on any of tho rings 
is raptnrod. 'I'his time is also generally referred to as residual time 
of tho token inter-arrival time (Hllr). Wlien the in ter- arrival time 
of n)essagcs (at caeli node) is at least 0.r>, tlie residual time is less 
than 0.3 msec. As the mean- time Ix'tween arrivals decreases, this time 
incK'ases signilirantly. (’ertainly, having mnitiph* rings residts in a 
reduced UUi\ 

• Figure 2 illustrates the eliect of number of rings on the average waiting 
time of a message. Under the exhaustive |)olicy, the average waiting 
time (UTr) is less than 1 msec for in < 0.3r>. The bcncrtl due to the 
presence of midtiple rings is more apparent at high loads. For low 
loads (m > 0.r»), the average waiting time is almost the same as RUr^ 
This is ol)vions since the queue sizes are generally very small. 

Under the non-exhanstive policy, single-ring networks cannot tolerate 
situations where m < 0.r». (This can also be proved analytically ), 
When there are at least 8 rings, the system can tolerate values of 
m > 0..35. When m = 0.:n, however, the system has very large queues 
(licnre not shown in the figure), resulting in very largo average waiting 
times. 

• Figure 3 snmniari/t's tlie relationship hetwet'ii average token inlerar- 
rival times and the nnmher of rings. Obviously, the average token 
inter-arrival time ( /^(7’|) at a node decreases with the number of rings, 
since the number f)f tokens is now increase<l. 'Fills decrease is more 
pronounced at high loads {in < 0.31). Under the non-cxiiaustive pol- 
icy, tho token intcr-ariival times ari' (piite low (even under higli loads). 
This is not surprising knowing that in tliis protocol at most one packet 
per node per token is only transmitted. With the exhaustive policy, 
however, tlie token ini ei -arrival times for the tokens coubi be signifi- 
cant for smaller number of rings. 

• Figured illustrates tlie ran<lomnoss of tho measured inter-arrival times 
of tokens. 'Fhis randomness is expresst'd in terms of the ratio of 
the standard deviation to tlie mean of tho token inter-arrival times. 
The ratios are higher for the non-exliaiistive policy. Since the non- 
exhaustivc policy sends at most one packet at a time, while the exhaus- 



tivo policy sends ;ill I l»e pending pnckH.s with a token, this observation 
is counter intuitive. \V(* ;u(' attcMiiptinj; to explain this ph(Miomenon 
throiij;h som<' probal)ilisti<* analysis, (ienerally, tliis ratio seems in iii- 
creas(' with th<' mimiHM of lin^s (;it h';»st up to M riiij;s). Hcyf)nd ei|;ht 
rings, the Ixdiavior of this ratio schmiis to depend on the lo«ad factor 
(m). 

• Figure 5 describes the relationship between response time and the 
number of rings for different loads. Response time includes the time 
to wait in the queue, the time for transmission, and the time for prop- 
agation from soil ice node to destination node. For low loads, since the 
waiting times are approximately constant, there is a slight increase in 
the response time with the increase in number of rings. The increase in 
response time may be explained by the increase in transmission delay 
due to reduced bandwidth per ring. I’he behavior of the average re- 
spon.se lime for br)lli uon-exhaiistive and exhaustive policies is similar 
to that of the average waiting times in the (pieue, 

• Figure G summarizes the variances in the respon.se time. This seems 
to be quite different from the variances in the waiting times. First, 
the variances of the exhaustive and non-exliaustive policy arc now 
comparable. .Second, the variances are much less than those in Fig- 
ure d. Once again, we are investigating the possible causes for this 
phenomenon. 

• Av('rag(' tok('ii rotati<»n time for (sveh ring is alsc) an important pn- 
formance metric. 'I'liis metric is shown in Figure 7. In the case of 
exhaustive policy, as expected, the token rotation time is independent 
of the number of rings (since increase in number of rings also increases 
the transmission delay by the same extent). The behavior of the non- 
ex haustivc policy needs more investigations. 

• Determining the probability with which an arriving token is used to 
transmit messages {fr) is useful in ilescribing the utilization of the 
network. This relationship is summarized in Figure 8. Clearly, the be- 
havior of fr differs under the exhaustive and non-exhaustive policies. 
For low loads (e.g. w = 1.0), both policies exhibit similar behavior. 

• Figure 0 summarizes the behavior of the average waiting time in the 
queue under the two policies. 'This is similar to Figure 5. Figure 1 1 
describes this information for messages that were not in the head of 
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i\\c. (|i!cuc (ol)viously rdc'vaiit. only wiUi ( ho oxhanstivo policy). Figure 
10 <lis))lays Uie av<M ag(* Uim* a nu'ssagc' vvail.<’(l fi(»m I, lie l.imr il. a rr! vcmI 
to the time its la.st l)it h'ft tlie node, (dearly, this is similar to the 
tiimvs in I'dgnres T> an<i 0. 

• The mmiherof packets I hat were transmitted per node for each arrival 
of a token is also a metric of interest. Figure 12 describes this metric 
(£’(//]). Not surprisingly, the patterns in this figure are similar to the 
ones in Figures 5,0, and 10. The plots for the non-exhaustive policy 
arc not relevant since it only transmits at most one packet each time 
with a token. 

• Network ntilizalion is a very important metric in <letermining llie al)il- 
. ity of a protocol to function at liigh loads. Figure 13 sununarizes this 

metric for the two policies. With the uon-exhaustive policy, with a 
single ring the network (actnally with a capacity of 1 gigabit/scc), 
can't have more than (>()% utili/.ation of the network capacity (even 
when the input load is high). 1'his is certainly a restriction. Similarly, 
a two-ring network cannot liave more than 75% utilization. 'Fho ex- 
haustive policy, however, seems to place no such restriction, and the 
utilization appears to he independent of the number of rings. 

4 Conclusions 

From tlie above residts, we make the following conclusions: 

• At all loads, irrespective of the policy, there is a gain in having multiple 
rings. Whether this gain reduces when the number of rings increases 
(and hence the bamlwidtii of each ring decreases) beyond a certain 
point, is yet to be seen. Wo propose to experiment with 32, 64, and 
128 rings to make stronger conclusions about this impact. 

• Gigabit speed networks with a small number of parallel rings (1,2, or 
3) will limit the utilization of the network. 'Fluis, the total capacity 
of the network can never be utilized. Tlie exhaustive policy, however, 
seems to perform well with any number of rings. 

• 'File ro<luction in response (ime seems to be significant with multiple 
rings and at liigh loads. (Certainly, tliere is a noticeable reduction in 
response even at tm^dium loads with tlie multiple ring structures. 



• 'riio token in ter- arrival sc'ems to he si^nilicantly affected by the number 
of rings and the choice of the policy. 'This fact is very significant when 
parallel networks are used to snppoi t nsd time ;ipplirations. 

In summary, the results ;u(' v('iy iiitcuesting, but Sf)ine more studies with 
other policies, bigger netwt)rks (more noib^s, larger lengths), and more rings 
need to be carried out before a well established guidelines arc set towards 
the design of parallel gigabit networks. 
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Figure 1. Mcim Residual Time for Messages al the Head of the Queue 
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Figure 5a: Exhaustive Policy 



Figure 4b: Nonexhauslive Policy 
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Figure 4. Standard dcviation/Mcan ratios for Token Inicr-arrival Times 
{N=r30, d= 1.0.55-1 OK) 










Figure 7a: Exhaustive Policy 


t 

Ellw] 

(msec) 



Number of rings (R) — 


t 

£(7VJ 

(msec) 



Number of rings (R) 


Figure 7. Average Token walk-times for each Rin 
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Figure 8. Fraclion of times that an Arriving Token is Used by a Node for Transmission 
(N=30.d=1.0,s=l0K) 
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Figure 9a. Exiiaustivc Policy 
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Figure 9. Average Wailing Times for Each Message (ai a Node) 
(N=30.d=1.0.s=10K) 
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Figure 11. Average Response Time for Non-header Messages in a Queue 
(Exhaustive Policy; N=30, d=l.O, s=lOK) 
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Num!>cr of rings (R) 


Figure 12. Average Number of Messages Transmilied |x:r Node Per Token 
(F.xhaUsSlivc Policy; N=3(), d=l.(), s=lOK) 











